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Abstract 

We describe a method to study the rate at which modes decorrelate in 
numerical simulations. We study the XY model updated with the Metropolis 
and Wolff dynamics respectively and compute the rate at which each eigen- 
vector of the dynamics decorrelates. Our method allows us to identify the 
decorrelation time for each mode separately. We find that the autocorrelation 
function of the various modes is markedly different for the 'local' Metropolis 
compared to the 'non-local' Wolff dynamics. Equipped with this new insight, 
it may be possible to devise highly efficient algorithms. 
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1 Introduction 



In the last few years there has been a lot of progress in finding new Monte-Carlo 
dynamics with little or no critical slowing down. This progress was initiated by the 
paper of Swendsen and Wang |] who described a novel cluster dynamics which was 
not in the universality class of local dynamics such as the Metropolis or heat-bath 
algorithms and had z < 1 for Potts models. Their results were later extended to the 
4 model || and to 0{n) models ||. For a recent survey see ||. 

However there has not been much progress in understanding what makes these 
improved algorithms work. The features that would contribute to improvement are 
easy to state: the dynamics must work on 'relevant degrees of freedom'. Unfortu- 
nately, these are difficult to isolate for most models. The Potts models are in a 
special, simple class where we expect clusters of spins to constitute the important 
degrees of freedom. However, even here, one does not know why the Swendsen- Wang 
algorithm has the dynamical critical exponent that it does. In our opinion, such an 
understanding would lead to the invention of better algorithms. One should note the 
work of Lee and Sokal || which established a lower bound on the dynamical critical 
exponent z for Ising models. However, many fundamental questions remain unan- 
swered, such as: Is there a universality class of 'non-local' dynamics? What is the 
mechanism behind the success of acceleration algorithms? Does the new dynamics 
apply to general gauge models, models with frustrations, and if so, how? 

In this paper we take a first step in this direction by describing a method to study 
the rate at which modes at different length scales decorrelate for any given dynam- 
ics. We use the XY model in 2-dimensions as a platform to describe our method. 
We introduce a large set of operators and measure their time-time autocorrelation 
function for Metropolis and Wolff dynamics. Translation invariance allows us to 
identify Fourier modes as eigenvectors of the autocorrelation matrix. We compute 
the eigenvalues of the Fourier modes as a function of time. These directly measure 
the rate at which the various modes decorrelate. 

Our results show that there is a marked difference between the two methods. In 
the Metropolis case, high frequency mode converge much faster than low frequency 
modes and it is the low frequency modes that govern the slow decorrelation in 
this dynamics. For the Wolff update, all modes decorrelate much faster than the 
Metropolis update. However, some high frequency modes of the Wolff dynamics are 
slower than some low frequency modes. This latter phenomena, to our knowledge, 
has never been demonstrated before. 

Because our method provides a direct way to study the rate at which modes 
equilibrate, it could be used to both find the slow degrees of freedom and also to 
check the effectiveness of different algorithms in accelerating them. We expect that 
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our method will help in fine tuning the search for effective algorithms. 



2 The Model 

The action of the two dimensional ferromagnetic XY model is: 

E = £ 003(6, - 9j) (1) 

<i,j> 

where i = (n x ,n y ), 1 < n x < L x and 1 < n y < L y . The lattice is square with 
periodic boundary conditions, (3 is the inverse temperature. This model has the 
famous K-T phase transition and has been extensively investigated numerically 
I 1,1- 

The 'local' dynamics we use is a parallel Metropolis algorithm. The dynamics 
is defined as follows: The lattice is decomposed into a red-black checkerboard of 
even and odd sites. All the even (odd) spins are updated simultaneously. A sweep 
is an update of the even spins followed by an update of the odd spins. The Wolff 
dynamics is implemented in its single cluster version ||. The origin of the cluster 
is chosen randomly and this fact makes the dynamics translation invariant. For the 
moment, we will define one sweep to be one cluster update. 



3 Autocorrelation Function 

Let us define the elements of the autocorrelation matrix M(t) to be: 

M id (t) =< cos(e i (0))cos(9 j (t)) > - < cos(6i) > 2 (2) 

where i = (n x ,n y ) as above. In various limits, M it j(t) is related to static quantities. 
Mjj-(O) is the static correlation function of the observables cos(9i) and hence it is 
independent of the dynamics. J2ij -^ij(O) is the magnetic susceptibility times the 
volume. Mjj(oo) is zero. For t between and oo, Mij(t) depends strongly on the 
dynamics. It is always easier to analyze the case where the dynamics is translational 
invariant. When this is true, Mij(t) = Mj +( y+d(£) where d is any lattice vector. In 
this case it is obvious that the eigenvectors of Mjj are the Fourier modes for any t. 

It is clear that 'typewrite order' Metropolis dynamics in two dimensions is not 
translationaly invariant []nj . The parallel checkerboard Metropolis algorithm we use 
is translation invariant for even k; that is, for k — (fci, k%) such that both k\ and ki 
are even. However, it is easy to define a set of variables for which the dynamics is 
translation invariant. These are block spin variables which are the sums of cos(6i) 
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on the four sites of a 2 x 2 lattice square. We will compute Mij for these variables. 
The Wolff dynamics we use is obviously translation invariant. We also use the 
same block variables for this dynamics to make the comparison between the two 
st raight forward . 

Let us denote the eigenvalue of M(t) by \?(t) where k is a vector in the first 
Brillouin zone. For each k one can assign a decorrelation time via: 

\ % {t) ~ e~ tlT * ,t-oo (3) 

4 The Results 

We have measured the autocorrelation eigenvalues Aj?(t) for both the Metropolis and 
Wolff dynamics for lattices with L=16 and (3 = 0.81, 0.83, 0.85, 0.87, 0.89, 0.91. Note 
that for = 0.91) = 20 > L || [| and so this temperature is already in the 'spin- 
wave' phase for this lattice size. We did five sets of 120, 000 sweeps each, discarding 
the first 20,000. We took 10, 000 measurements of the autocorrelation function of 
Eq.2 with ten sweeps between each measurement. The reason we were limited to 
small lattices is that it is quite time consuming to measure the correlation function 
for all pairs i, j 'in Eq. 2 (which is what we did). If one knows the eigenvectors it 
is of course possible to measure only the autocorrelation matrix for them directly. 
This results in a much smaller matrix (in our case, it reduces the matrix M from 
64 x 64 to 8 x 8). This is the preferred approach for future analysis. 

In Fig. la-f we show for both dynamics as a function of update time T for each 
(3 value. The time T is the number of updates of both colors of the checkerboard 
in the case of the Metropolis algorithm. For the Wolff algorithm, the appropriate 
definition for T is the number of cluster updates times the average cluster size divided 
by the number of lattice sites. We have only plotted the data for T < 40. In reality, 
our measurements extended out to T = 100. We plot only the first three modes 
corresponding to k = (0,0), k = (0, 1) and k = (0,2) where we measure k in units 
of 27r/L. The error bars on the correlation functions were estimated by repeating 
each measurement up to five times and computing the standard deviation. 

We fit the data for to Eq.3 in the region where T was large enough for this 
relationship to be valid. From these fits, we extract the autocorrelation time r which 
is shown function of (3 in Figs 2, 3a, and 3b. 
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5 Discussion 



First it is clear from Fig.l that the Wolff algorithm is much superior to the Metropolis 
algorithm. All Fourier modes decorrelate faster at all temperatures for it. It is also 
evident from Figs.l and 2 that for the Wolff algorithm, the zero mode is much 
faster than the other modes. This unusual fact can be seen most clearly in Fig. 2 
where the r for the zero mode is the smallest for all (3 values. One also sees in 
Fig. 1 that the modes exhibit different short time behavior. In Fig. 2 we clearly 
see another interesting property of the Wolff dynamics. The autocorrelation time 
is generally larger for shorter distance modes. This should be contrasted with the 
opposite behavior of the 'local-Metropolis' where the shorter distance modes (modes 
with higher k) generally decorrelate faster than longer distance modes (modes with 
lower k). This pattern is what one would expect given the fact that the Metropolis 
algorithm is local and so should accelerate short distance modes and the Wolff 
algorithm is more global and so should do a better job for longer distance modes. 
However, the rich pattern that is evident in Figs. 2, 3 is not completely intuitive. For 
example, in Fig3b, one would expect the k = (0, 3) mode to be faster than the 
k = (0, 1) mode but the data clearly shows that the reverse is true. On the other 
hand, the relative order of the modes (0, 2) and (0, 1) is what one would expect for 
a local algorithm. 

One might be able to use the information in Figs. 1-3 to arrive at an algorithm 
that can take advantage of the best features of the Metropolis and Wolff dynamics. 
This would involve doing some number n\ of Metropolis sweeps followed by some 
number n 2 of Wolff sweeps. By monitoring the dynamics of a few modes as we 
have done in this paper and changing n x and n 2 one would arrive at the optimum 
algorithm. One can obviously also add in other methods such as the multigrid 
method |J and the over-relaxation method Jll| to get a truly hybrid algorithm. 
In fact, it may be that one need not actually have to adjust the n^s to find the 
optimum combination if the function is known for all t and for all modes. One 
might then be able to do an analytic calculation to find the optimum n^s. 

It is well known that there are other degrees of freedom which are important 
in the XY model; viz., the non-local vortex excitations ||. We believe that for a 
complete treatement of this model one should include the vortices as well as spins in 
the definition of the auto-correlation matrix M(t). In fact, we have tried to do this. 
However, we found that the contribution of the vortex- vortex and spin- vortex part 
of M{t) was insignificant when compared to the spin-spin part in Eq. 2. This comes 
from the fact that the vortex density is almost everywhere zero and any non-trivial 
vortex contribution to M{t) is swamped by the spin contribution. One might study 
the vortices by themselves and see what can be learned from them before attempting 
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to get information about the correlation between the dynamics of vortices and spins. 
However, the issue of the relative normalization of spin and vortex densities remains. 

We hope to take up the issues discussed in the last two paragraphs in a future 
publication. 
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Figure Captions 

• Figure la-f: against the time T to update L x x L y spins for different 

— * 

temperatures. For each k, the slower dynamics is Metropolis and the faster is 
Wolff. 

• Fig2: Decorrelation time r as a function of [3 for various k for the Wolff 
algorithm. Only the error bars on the least accurate data are shown. Note 
that the zero mode decorrelates the fastest (has the smallest r). 

• Fig3a: r versus /3 for the zero mode for the Metropolis algorithm. Note the 
relative scale of this figure and Fig. 2. 

Fig3b: r versus (3 for some other modes for the Metropolis algorithm. Again, 
only one set of error bars are shown to give a feeling for the accuracy of the 
data. 
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